Menus & Other Regions Not To Index

Certain regions of documents/pages are ideally not indexed for searching, for example, a web-site menu may contain the names of all products on the web-site, clearly if every page contains this menu, then a search for any product name will yield all pages. To prevent this, these regions should be identified before indexing the pages commences. A page can contain any number of regions to ignore. Ignore regions do not affect the spider, which will still crawl links found in ignore regions.

eg. ignore sections of HTML using these comments

<!--keyoti_search_ignore_begin-->
...region to ignore
<!--keyoti_search_ignore_end-->

Changing Ignore Region Tags

Before building an index, set the IgnoreBlockBeginPattern and IgnoreBlockEndPattern properties in the Configuration, see the Configuration section for more information.

eg.

IgnoreBlockBeginPattern ="<!--start menu-->"

IgnoreBlockEndPattern ="<!--end menu-->"